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Abstract 

A general class of Markov processes with a local interaction is intro- 
duced, which includes exclusion and Kawasaki processes as a very particu- 
lar case. Bernoulli invariant measures are found for this class of processes. 
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1 Introduction 

The goal of this paper is to introduce a class of processes with a local interaction, 
which we call exchange or Boltzmann processes as they model transformations 
of the internal degrees of freedom and/or chemical reactions for pairs of parti- 
cles. The introduced class of processes includes such well-known processes as 
exclusion processes and Kawasaki processes. 

The definition is as follows. Consider a graph G, finite or countable, with the 
set of vertices V = V{G) aird the set of edges L — L{G). We define configuratioir 
as a function Xt,, w G V, on the set of vertices with values in some set X . The set 
X can be interpreted as the set of all characteristics of a site v G V{G) and/or 
of the particles sittiirg at v (such as the types of particles, their form, energy 
etc.). 

On the set X^ of coirfiguratioirs a continuous time Markov process = 
^G,F,{\i} defined as follows. The transitions occur for each edge I = {v,v') £ 
L{G) with rate A; = Xi{Xy,Xy>), independently of all other edges. For a given I, 
the transition is a simultaneous transformation (binary reaction) of the spins 

{x4t),Xy,{t)) {x4t + dt),Xy,{t + dt)) = F{xy{t),Xy,{t)) (1) 

where F: S — XxX^S — XxXis some fixed mapping. We always assume 
F to be symmetric, that is Fj = jF, where j{xi,X2) = (x2,xi). This explains 
why the order of vertices in ((T]) does not play any role. Thus, the process on G 
is defined by a function F and by the set of functions A/(a;.y, Xyi) = Xi{xyi , Xy), 
also assumed to be symmetric. 
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If the set X and the graph G are finite, then this defines a finite continuous 
time Markov chain, which we denote by ^t. Otherwise, for the existence of the 
process, one should impose some weak restrictions on F and A/. 

The introduced process is a process with local interaction, these processes 
play nowadays an important role in constructing physical models, see for exam- 
ple PQI31H]- A particular case are Kawasaki processes, where a pair of points 
exchanges spins, that is is a permutation. Even more popular are exclusion 
processes, where X = {0, 1} and F is also a permutation. In general the choice 
of F should correspond to the transformation of degrees of freedom of neighbour 
particles (for example, of water molecules) or to chemical reactions. As far as 
we know, such processes were never studied in sufficient generality. 

The first problem we are solving here: for given F and A;, describe all 
invariant Bernoulli measures (IBM). A measure /i on X^ is called Bernoulli, if 
for some probability measure v on X we have 

V 

^ = h'Xh'X... = h' . 

Such measures are well-known and are very important for the study of exclusion 
processes, see [3|. 

2 Invariance criteria 

We assume here that X and G are finite, and F is assumed to be one-to-one. 
Due to compactness, at least one invariant measure always exists. Moreover, 
if F is one-to-one, then the uniform measure on X^ is invariant. We want to 
know for which maps F there exist other invariant Bernoulli measures. 

Let J/ be a probability measure on X. Let us consider the measure ^ vy.v 
on the set S = X y. X. Let take k different values, di,d2, - ■ ■ ,dk- Define a 
partition {Si} of the set S such that Si consists of all points of S where v"^ takes 
the value di. 

Note that the map F can be uniquely expanded on a finite number of cycles 
on S. Let Ci, . . . , C„ be the supports of these cycles. We say that the measure 
v agrees with the map F if the support of any cycle of F belongs to only one 
of the sets Si, i = 1, . . . ,k. In other words, the partition {Cj} is finer than the 
partition {Si}: for any Cj there exists Si such that Gj ^ Si. 

The following result gives a convenient criterion to check whether a given 
Bernoulli measure is invariant for given F. 

Theorem 2.1 Let finite X, G he given and let F he one-to-one. Assume that 
for any edge I the rates A; — \i{s) satisfy the condition: Xi{s) = Xi(F^^{s)) for 
all s G 5. Then the following conditions are equivalent: 

1. Bernoulli measure ^ — v x v y. . . . = is an invariant measure of the 
Markov process for any finite graph G. 

2. The measure is an invariant measure of the Markov process for the 
graph G2 with two vertices and one edge hetween them. 



2 



3. The measure is invariant with respect to F . 

4. The measure v agrees with F in the sense defined above. 

Proof Firstly, it is evident that conditions 3 and 4 are equivalent, that is, 
the invariance of i/"^ with respect to F is equivalent to the fact that i/^ takes 
constant values on the support of each cycle of F. It is also evident that 1^2. 

Let us prove then that 2 1. In fact, let G, X, F be given and let / be the 
edge with vertices v and v' . Denote ^j''' the Markov chain on in which the 
only transitions are at the edge (v, v'): 

i^Xy , Xy' ) ^ Fi^Xy , Xy' ) , 

with rates Xi(xy, Xy'), that is, the remaining Xii{xy,Xyi) — 0, I' ^ I. It is clear 
that if the condition 2 holds, then the Bernoulli measure on G is invariant 
with respect to any Markov chain . Then we get the assertion from the fol- 
lowing general and evident proposition. Let a collection ^f-* of Markov processes 

on the same state space A be given, with the rates A^^'^, a, (5 £ A, a ^ (5, cor- 
respondingly. Let moreover all the processes have the same invariant measure 
TT = {TTa}- Then the Markov process on A with rates ^ap — J2i ¥^ 
has the same invariant measure. The proof of this proposition is immediately 
obtained by summing over I the equations for stationary probabilities of ^j'-* . 

Let us prove now that 3 2, that is, if v'^{s) — v'^{F^^{s)) for any s £ S 
then the measure is an invariant measure of the Markov process for the 
graph G2 with two vertices and one edge between them. To do this, let us write 
down the equations for the stationary probabilities of the Markov chain on G2'- 

Xiisyis) = Xi{F-\s)yiF-\s)), s e S. 

They evidently hold under our assumptions. This implies 2 3 as well. □ 



3 Description of invariant measures 

Theorem l2.1l allows for given F to check whether a given Bernoulli measure 
is invariant or not. To classify all invariant Bernoulli measures for given is a 
more complicated problem. We give now simple combinatorial algorithms which 
allow, for given F, to construct all IBM. 

Let a measure v take values ai,...,a,„, all different. Denote Xi = {x : 
i/{x) — Gi} and Sij — (Xi x Xj) U {Xj x Xi) — Sji. We say that a measure 1/ 
is a general situation measure if all pairwise products aiUj are different. The 
partition Xi, . . . , Xm defines a (m — l)-parametric family {(ai, . . . , a„i), ai -f 
. . . -I- Qm = 1} of general situation measures. We say that an IBM i/^ is a 
general situation measure if is a general situation measure. We will describe all 
such measures, under some assumptions. Let us note that for general situation 
measures any cycle Ck of F belongs to only one set Sij, that is, all Sij are 
different. 
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A set ^ C 5 is called connected, if for any two elements (a, &), {a',b') G A 
there exists a chain of elements (a^, bi) €z A, 

(a, b) = (fli, &i), (02, &2), (03, ^3), • ■ • , (fln, K) = (a', b') 

in which all subsequent pairs have a common element, that is, 

{{a,} U {5J) n ({a,+i} U {b,+i}) 7^ 0, ^ = 1, . . . ,n - 1. 

Obviously, any set B can be uniquely partitioned into connected components. 

We shall give an algorithm for constructing all general situation IBM in case 
when all the cycles of F are connected. 

Theorem 3.1 // all the cycles of F are connected then, among the partitions 
agreeing with F, there exists a unique minimal partition {Sij = {Xi x Xj) U 
{Xj X Xi)}. Any general situation IBM belongs to the family of IBM defined 
by this minimal partition. The minimal partition {Sij} is constructed by the 
algorithm given in the proof. 

Proof A set A C 5* is called half-admissible, if it can be represented as 
74 = ^1 X X2, where either Xi = ^2 or ATi n ^2 = 0. A set A C 5 is called 
admissible, if it can be represented as A = {Xi x X2) U {X2 x Xi), where 
either Xi — X2 or Xi H X2 = 0. Half-admissible and admissible sets are always 
connected. 

Lemma 3.1 For any connected set B (Z S, among admissible sets containing 
(covering) B there exists a unique minimal admissible set covering B. 

Proof of Lemma 13.11 The proof of this lemma consists in direct construc- 
tion of such covering set. Let us construct first a half- admissible set Xi x X2 
containing B. To do this, take some element (a, 6) G B. Put, for example, 
a G Xi,b G X2. li a = b, then it follows that Xi — X2. In this case the minimal 
set will be the set Xi x Xi , where Xi is the projection of i? on X (the projection 
of the set i? C S* = X X A" on X is the set of all elements x G X such that there 
exists a G X such that either (a, x) or {x, a) belongs to B). 

Consider now the case when a ^ b. Then necessarily b G A2 , and also for all 
{a,x) G B necessarily x G A2. Continuing this process, due to connectedness of 
B, we encounter all elements of B and will construct Xi and A2. During this 
process it can occur that some element c belongs both to Xi and to X2 ■ Then, 
by definition of half-admissible set, it should be Xi — X2. The symmetrized set 
B = (Ai X A2) U (A2 X Xi) is called the closure of the set B. The lemma is 
proved. □ 

We return to the proof of Theorem 13.11 Let Ci be the closure of the cycle 
Ci. To each cycle d there corresponds a symmetric cycle C*^'", where all 
elements of (7**"" are the permutations of the elements of Ci. Moreover, either 
^sym ^ ^sym p Q ^ 0^ ^hcn Di = " U d define a covering of the set 

S, however, they can intersect with each other. If some Di and D2 intersect. 
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then their union is connected. In this case one can take Di U D2, -D3, . . . , -Dm 
instead of the cohection of sets Di, D2, ■ • • , Dm- On each step of this procedure 
the number of sets in the covering diminishes by 1, and finally we get a system 
of non- intersecting admissible sets which defines the partition {^^^i}, and thus 
all general situation IBM. The resulting partition does not depend on the order 
in which we choose the pairs of intersecting subsets, since at each step we take 
the minimal admissible set. The theorem is proved. □ 

If there exist non-connected cycles, then several families of IBM are possible, 
as Example [3] below shows. An algorithm for constructing all such families is 
similar, but more involved, we discuss it below. 

Example 1. Let us consider Kawasaki processes, when F is the permuta- 
tion. In this case all the cycles have the length 1 or 2. Then each Xi consists of 
one point only, and each Sij consists of one (if i = j) or two (if i ^ j) elements. 
Then any Bernoulli measure is invariant. 

Example 2. Let F{a,b) — {f{a),f{b)), where / is a one-to-one mapping 
X ^ X having the cycles X,. Then 5^ = {X, xXj)U {Xj x Xi) define all IBM. 

Example 3. The simplest example when there exist two general situation 
IBM is as follows. Let X consist of four points, that is X = {xi, a::2, X3, a;4}. Let 
any cycle of F consist of one point only, except for the following two cycles: 

Ci = {(xi,X2), {X3,X4:)} C S 

and the symmetric one, 

^symm ^ {[x2 , Xl) , {xi, X3)} , 

consisting of two points. Then there are two admissible partitions, Xi = 
{xi, X3}, X2 = {x2,X4} and X[ — {xi, X4}, X2 — {x2,X3}, which define two 
one-parametric families of general situation IBM. 

Further on, we shortly describe the algorithm for constructing all families 
of IBM in the general case. Let us show first that for any set B C S there 
exists a unique minimal covering (that is, the covering belonging to any such 
covering of the set B) by non-intersecting half-admissible sets. In fact, if B is 
not connected, then for any its connected component Bi consider the closure 
Bi. It is easy to see that Bi do not intersect. Then the minimal half-admissible 
sets covering Bi do not intersect as well. 

Let Ci be all the cycles of F, and Cij be all connected components of the 
cycle Ci. Take the closure Cij of each Cij. Firstly, for any i we construct a 
minimal admissible set Ai containing all Cij. The problem is that there can 
be several such Ai (see Example [3]). Then for given Ai we construct, as above, 
(already unique) minimal partition {Su} such that each Ai belongs to one of 
the sets Ski. 

4 Generalizations and remarks 

Maps which are not one-to-one 
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Let us consider the case when F is not one-to-one. A point s G S is called 
cyclic if s = i^"(s) for some n > 0, where F" is the nth iteration of the map F. 
The set of cyclic points is subdivided onto cycles. The remaining points are 
called inessential. 

From the definition of invariant (with respect to F) measure it easily follows 
that the invariant measure is zero on the set of inessential points. Let a measure 
V on X take values ag = 0, ai, . . . , Uk- Put Xi = {x G X : h'{x) = ai}, Xq ^ 0. 
Then {Xq x X) U {X x Xq) contains the set of inessential points and possibly 
also some cycles. Let Ci, C2, . . . , Cm be all the cycles of the map F which do 
not belong to (Xq x X) U {X x Xq). 

If, instead oi X, we consider the set X \ Xq, then {X \ Xq) x {X \ Xq) 
is invariant with respect to F and is the union of the cycles Ci, C2, . . . , Cm, 
and, moreover, the map F on {X \ Xq) x {X \ Xq) is one-to-one. It means 
that the description of invariant measures can be reduced to the case when F 
is one-to-one. 

Countable X 

This case is quite similar to the case when X is finite. In fact, if F has 
infinite cycles, then i/^ should be zero on them. Thus, one can delete from X 
the projections of all infinite cycles, that is we can restrict ourselves to the case 
when all cycles are finite. All the rest is similar to the case of finite X. 

Oriented graph 

Our results take place also in a more general case when the graph G is 
oriented. The map F from S — X x X to itself is not necessary symmetric. 
Moreover the intensities A; {xy , Xvi ) may be non-symmetric functions of the spin 
values. However, the condition Xi{xv, x^i) — Xi{F^^{xy, Xy')) should be fulfilled. 

Links with physics 

The introduced processes have many links with physics, on the intuitive 
level. For example, the book |4j explains many facts of behaviour of liquids 
and amorphous bodies using stochastic exchange interaction between nearby 
molecules. It gives an alternative to the common approach based on hard-balls- 
type models. 

However when one tries to derive an exchange process from the existing 
fundamental physical theory, one encounters many difficulties. For example, 
what is the set of states (that is, the set X introduced above) for the water 
molecules? The simplest classical model of water molecule includes at least the 
lengths of segments OH and the angles between them. The known quantum 
mechanical model is even more complicated: it defines a tetrahedron using 
molecular orbitals [5]. Moreover, it is known that chemical bonds of hydrogenic 
character may appear between closely situated water molecules — one molecule 
can have up to 4 such bonds. They form a random graph of bonds (edges) which 
presumably defines such properties of water as density, viscosity, heat capacity 
etc., and their abnormal character comparing with other liquids. In this context 
one can remark that the time dependence, even random. A; = Xi(t) does not 
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change the invariant measures, under keeping the symmetry condition for any t. 
This means also that the graph G itself (depending on the configuration of 
particles in the space) does not play an important role, since we can consider 
the complete graph where some A; = 0. 

Some problems 

It could be interesting to get similar results for the case when X is a smooth 
manifold. In this case conservation laws play an important role. For finite X, G, 
an additive conservation law is a function E on X such that if F{x, y) — (xi, yi) 
then 

E{x)+E{y)^E{xi)+E{yi). 
If v is an IBM and G is an arbitrary constant, then the conservation law is 

E{x) = G\niy{x). 

Other interesting possibilities are when F is random (see some examples in 
[6]) or even when F is quantum and X is a Hilbert space. 
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